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1.   Introduction 


The  comparison  of  sampled  distributions  is  one  of 
the  classical  problems  of  statistics.   Evaluation  of 
any  technique  for  doing  so  depends  at  least  implicitly 
on  an  assumed  cost  function.   In  one  of  the  most  impor- 
tant applications,  that  of  choosing  treatments  for  the 
ailments  of  man,  costs  are  measured  in  suffering  and 
death,  and  must  be  accorded  primary  importance.   In  this 
lecture,  I  would  like  to  address  a  highly  simplified 
but  in  fact  prototypical  situation  of  this  kind.   It  is 
that  in  which  two  drugs,  A  and  B,  are  available  for  a 
specified  illness,  their  actions  are  unequivocal  or 
dichotomic:   success  or  failure,  and  this  action  is  on 
a  time  scale  short  compared  to  that  on  which  patients 
receiving  the  drugs  present  themselves.   The  assumption 


is  that  the  mode  of  treatment  with  each  drug  is  sufficiently 
stylized  that  each  drug  can  be  fully  represented  for 
each  patient  independently  by  success  probability  p. 
The  problem  then  is  to  design  a  sequential  selection  of 
treatments  so  that  the  drug  with  the  higher  success 
probability  is  used  as  often  as  possible  [1] . 

2.   Basic  Sampling 

The  classical  sampling  method  is  direct  and 

basically  unsophisticated.   A  large  set  of  patients  is 

treated  simultaneously  or  sequentially  -  it  does  not 

matter  -  by  random  choice  of  one  of  the  two  drugs  and 

the  data  is  collected,  resulting  in   fAna   successes 

on   n_   trials  with  drug  A,   f^n^   on   nn  trials  with 
A  ^       B  B        B 

drug  B.   If  the  unknown   underlying  success  probabilities 
for  the  two  drugs  are  p   and  pR  ,  the  difference  of  the 
observed  relative  frequencies   f   and  f   has  a  mean  and 
variance 


E  (fA  "  V   =   PA  "  PB 

2  if  f  1  -  ^  +   ^^  (1] 

0    (fA  "  V  "  -n—  +   -n— 
A        B 


where 


qA  =  1  "  PA  '   qB  =  1    ~    ?! 


determining  a  normal  distribution  for  large  enough 
sample  size: 

,  -1/2  2     2 

P  (fA  -  fB)  =  (2na  )      exp  -  (fA  -  fB  -  E)  /2a        (2) 

In  particular, 

co    x2 

P  (f.  -  f_  >  f  +  E)  =  —    f  e    2   dx  (3) 

A     B  ~  /2?   -J 

a 

Thus  if  the  claim  is  made  that   p   >_  p  or   E  <_  0  , 
and  observation  yields  f  A  -  f   >_  f  ,  the  claim  is  to 
be  rejected,  and  hence   p,  >  pR   accepted  with  a  con- 
fidence 

.o   .:2 

e  ^    dx  (4) 


i-/^| 


2 
For  this  purpose,  of  course,  a      is  estimated  as 


,  f.d  -  £.)        f_(l  -  f„) 

°2'fA-  V~  A  n.   A    +   -V^  ,5: 


What  does  the  knowledge  that  pA  >  pR  with  high 
confidence  mean?   It  presumably  means  that  if  we  now 
use  drug  A  for  a  large  population  of  size  M,  the 


expected  number  of  patients   following  the  sampling 
who  receive  the  wrong  drug  because  of  our  misplaced 
confidence  is*"^M(l  -  p)  ,  and  hence  the  expected 
excess  number  of  failures  after  sampling 
Cnq'^M(l  -  p)  (p   -  p  )  .   Evaluating  (4)  asymptotically 
for  large   n   ,  n   ,  or  small  o  ,  then 

1  f2 
M(PA  -  p  )f     -  \   §2 
C,e~— A,    B      e  l    oZ  (6) 

V2noZ 

1 

,  .,    2   -an 
f>*^    k  M  n   e 


n   and  suitable  constants 


In  M  (7; 


We  will  next  formalize  this  procedure 


3.   Effect  of  Patient  Horizon 

We  turn  from  the  somewhat  vague  notion  of 
confidence  to  the  explicit  one  of  cost,  expressed 
as  mean  excess  failure  rate  in  treating  a  population, 
due  to  our  initial  lack  of  knowledge  of  the  success 
probabilities  of  the  drugs  involved.   To  design  an 
effective  sampling  strategy,  we  will  assume  some  fore- 
knowledge, however,  of  the  total  population   N   to  be 
treated,  the  so-called  "patient  horizon".   In  the  con- 
text of  the  classical  sampling  techniques,  the  problem 
then  is  to  decide  how  extensive  a  period  of  random 
sampling  is  to  be  used  before  settling  on  the  better 
drug  and  using  it. 

For  simplicity,  but  not  necessity,  we  assume  that 
in  the  sampling  period,  drugs  A  and  B  have  each  been 
tried  ■=      times,  a  decision  made,  and  the  drug  of  choice 
used  on  the  remaining  population  of  M  =  N-n   patients. 
Suppose  that  pA  >  pR  and  that  there  are  A  successes  with 
drug  A,  B  with  drug  B  during  the  sampling  period.   Then 
since  B  will  be  chosen  if  B  >  A  at  the  end  of  the 
sampling,  the  number  of  excess  failures  for  the  complete 
set  of  N  patients  is  clearly  given  by  the  contribution 
Cs  during  sampling  plus  CAg  after  sampling: 


C(A,B)  =  pAn  -  (A  +  B)  +  (pft  -  pB) (N  -n)  0  (B  -  A) 

C\  for   X  >  0 

where   9  (X)  =  -J  1/2  X  =  0                        (8) 

0  X  <  0 


Averaging  over  the  binomial  distribution  for  A  and  B, 
the  mean  excess  failures  are  then 


C  =  (pA  "  PB}i  +  (9) 


:#) 


-n)aIB|        \A<2'K     pX/2'" 


To  put  C  into  a  usable  torm,  we  may  first  express 
(B  -  A)  as  a  contour  integral 


A)  =  sfitJt 


iS(B-A)  ds 
e  S  (10) 


after  which  the  summations  over  A  and  B  are  easily  per- 
formed, yielding 

>A  ~    PB}  2  (II) 

n  ,  v  n 


+  (p^  -  pB)  (N 


.  1  ->CdS  /   -iS^  \l    f        iS^   \2 
'n)2lFry  ~S  (PAe    +  qAJ   (^PBe   +  *b}    . 


Unless  n  is  small,  a  saddle  point  expansion  in  S  is 
appropriate.   The  saddle  point  S  is  found  to  be 

ei§   =   <T1/2  d2: 

where    «  =  Pnqa  /  ?*% 


'B^A  '  ^A^B 


and  so  on  substituting 


Ca;(Pa  "  PB)  (j   +  k(N-n 


)  Y  ) 


where   Y  =  /p^  +  ^p^  (13) 

2  1/4    /PAq 
1/k   =   (PAPB^Bn  }      ln(^PB 

If  N  is  fixed,  the  cost  C  can  now  be  minimized  by 
choice  of  the  sample  size   n,  and  for  N  >>  n  we  readily 
find 

(PA"PB)   lnN 
Mm  C   ~   ^ In  1/y  (14) 

at  Yn  ■ — '   l/(2NklnVY)   » 

consistent  with  the  estimate  given  by  (7) .   For  a  better 
feeling  as  to  how  this  procedure  is  affected  by  the 
underlying  probabilities  pA  and  pB  ,  suppose  that 
o   -  d  =  A  is  small.   Expanding  in  A  ,  we  have 


A2  -i  r- 

Y  ~'  1  -  k i      k  — '  A   /pq/Tr   ,   and  so 


8pq 


if 

PA  -  PB   =   A  «  1 

MinC~4pq     If.  (15) 

at  n^j   -29.   ln  N  . 

A2 

for  small  A  ,  we  of  course  need  a  longer  sampling  period, 
but  more  importantly,  we  are  guaranteed  to  raise  the  total 
mean  excess  failures. 

4.   Controlled  Sampling 

We  have  thus  far  described  a  quite  rigid  strategy: 
given  an  estimate  of  the  patient  horizon  (and  an  implied 
estimate  of  the  range  of  success  probabilities  to  be 
encountered)  we  fix  an  optimal  sample  size   n   and  carry 
out  the  sampling  accordingly.   Thus,  no  advantage  is 
taken  of  the  particulars  of  the  information  actually 
obtained,  which  could  very  well  allow  a  decision  to  be 
made  at  an  earlier  stage.   This  leads  to  the  notion  of 
a  stopping  rule,  in  which  the  sampling  is  terminated  when 
sufficient  information  is  available  to  make  a  decision 
according  to  some  predetermined  criterion.   The  criterion 
is  based  traditionally  upon  establishing  a  superior  drug 


to  at  least  some  designated  probability. 

Two  sampling  strategies  have  received  principal 
attention  [2] :   vector-at-a-time  and  play-the-winner . 
The  first   of  these,  vector-at-a-time  or  VT ,  is  a 
slight  modification  of  the  random  sampling  we  have 
discussed  above.   In  VT,  one  creates  equal  samples  of 
A  and  B  by  the  fixed  procedure  of  alternating  drugs 
A  and  B  :   ABABAB . . .  ,  so  that  the  unit  test  is  the 
pair  AB.   Again  denoting  the  total  successes  with  A 
by  A  and  with  B  by  B ,  a  cutoff   s  is  chosen,  together 
with  the 

Stopping  rule:   Terminate  the  sampling 

and  choose  drug  A  the  first  time  that         (16) 
A  -  B  =  s  before  A  -  B  =  -s    , 
and  of  course  vice  versa.   The  questions  asked  are  then: 
What  is  the  probability  that  a   correct  choice  has  been 
made?   How  long  does  one  expect  the  sampling  to  take? 
To  answer  these  questions,  we  observe  first  that 
as  the  result  of  each  pair  of  tests,  A  will  have  in- 
creased by  1  with  probability  pft  ,   B  by  1  with  prob- 
ability p   .   Hence,  simplifying  notation  by   PA  =  P  , 
_   .     t  _  _.  =  q'   ,   the  change  in 

i  -  pA  =  q  •    pb  -  p  '  l      pb  4 

A  -  B  is  given  by 
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[    i  pq' 

A(A-B)    =    J     0   with   probability      pp '    +    qq '  (17) 

(-1  p'q 


Furthermore,  the  probability  of  deciding  on  A  as  the 
drug  of  choice  is 

CO 

P  (choose  A)  =  I    P(A-B  =  s  at  the  n    pair, 
n=l 

| A-B |  ^  s  at  prior  pairs)  (18) 


Suppose  that  the  system  is  described  by  a  state  space 
of  vectors  (v(j)}  whose  j    component  is  the  probability 
that   A  -  B  =  j  ,  and  with  t   unit  vector  designated 
by  u..  Define  Q+  to  project  onto  the  complement  of 

A  -  B  =  +s  : 

(Q+  v)  (j)  -  (1  -  6j/  +  s)v(j)   .  (19) 

Then  if  P  is  the  transition  probability  matrix  defined 
by  (17) 


(20) 


the  first  n-1  steps  of  (18)  are  given  by  Q+Q_p, 
and  (18)  transcribes  at  once  to 


11 


P  (choose  A)  =  I   us  p(Q+Q_p 


n-1 


=  Ug  P(I-Q+Q_p)  -1  uQ 


To  evaluate  (21) ,  we  write  it  as 


(21) 


where  (22) 

v  -  Q  Q_Pv  =  us  , 

or  in  component  form,  using  1  =  pp '  +  qq '  +  pq '  +  p'q  , 

|t|  <  s:  pq'(v(t)  -  V(t-l))  +  p'q(v(t)  -  v(t+l))=  6fc  Q 

v(s)  =  v(-s)  =  0 

(23) 

The  linear  difference  equation  (23)  has  the  character- 

2 
istic  polynomial   pq' (x  -  x  )  +p'q  (x-1)  =0    and 

hence  the  elementary  solutions 


i1 

x     ,   x  =  \ 

L6 


v(t)  =  x     ,   x  =  \  (24) 

p ' q/q ' p 


Substituting  into  (23)  we  find 


s  >  t  >  0  :   v(t)  =     —  (25) 
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and  hence  conclude  that 

1 
P(choose  A)  =  (Pv)  (s)  = (26) 


1  In  1 


/e 


P  (correct  choice)  >_   .  +    if   s  >_     ,   ,  ,g  (27) 


The  expected  number  of  trials  required  to  come  to 
a  decision  is  dirivable  in  similar  fashion: 


E(n)  =  I    nu^P(Q+Q_P)n  1  uQ  /  J  u^P(Q+Q_P)n  \i 
n  n 


u^(I  -  Q+Q_  P)  2  uQ  /  u^P(I-Q+Q_P)  X  uQ  (28) 


1  +  t-  In  (u'P(i  -  yQO  P)  X  un) | 

'  Y=l 


which  works  out  to 

1  -  6s 
E(n)  =  s .  (29) 
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5.   Ethical  Sampling 

The  stopping  rule  strategy  is  a  first  step  in  using 
the  accumulated  information  during  a  sample  to  modify  the 
nature  of  the  sample.   But  it  operates  on  a  global  basis: 
the  sampled  population  still  effectively  constitutes  a  set 
of  guinea  pigs,  although  care  is  taken  that  no  more  guinea 
pigs  be  used  than  necessary.   An  ethical  procedure  for 
sequential  trials  would  be  to  give  each  patient  the  benefit 
of  the  prior  information,  so  that  none  serve  merely  as 
guinea  pigs. 

A  step  in  designing  such  an  ethical  strategy  is  to 
at  least  have  the  drug  administered  to  a  given  patient 
according  to  what  happened  to  the  preceding  patient.   This 
is  the  "play-the-winner"  or  PW  scheme,  in  which  a  patient 
is  given  drug  A  either  if  A  was  tried  and  it  succeeded  or 
if  B  was  tried  and  it  failed;   B  is  given  in  the  reciprocal 
case.   If   the  stopping  rule  (16)  is  now  applied,  the 
analysis  proceeds  as  in  the  VT  case,  with  some  modifica- 
tion occasioned  by  the  lack  of  a-priori  knowledge  of  the 
drug  to  be  given  to  the  nfc  patient.   Thus  the  state  is 
now  built  from  unit  vectors  in  which  A-B  is  fixed  and  a 
specified  drug  is  to  be  used  next. 


Hence  we  write 
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P  (t.a)  =  P  (arrive  at  A-B=t  after  n  trials 
n 

and  will  next  use  (B  as  a  =  {Q  ] 


(301 


The  transition  matrix  is  clearly  given  by 
Pn(t,l)  =  p  Pn-1(t-l,l)  +  q'Pn_1(t,0) 
Pn(t,0)  =  q  Pn_1(t,D  +  p'  Pn_1(t+1,0) 

for  n  _>  1  . 

If  the  first  patient  will  receive  A  or  B  with 
probability  1/2  then  pQ(t,  a)  =  1 /2  6   Q   and  equation 
(23)  is  now  replaced  by: 


(31) 


|t|  <  s  : 


v(t,l)l   fp  01  j"v(t-l,l)1  f  0  q") 
v(t,0)J   [o  0j|v(t-l,0)J  [  q  0  J 

'0  0)  [v(t+l,l)l    [V2] 

,0  p'J  (v(t+l,0)J    [l/2j  6tjQ 

ly(-sf0)J 


v(t,l) 
v(t,0) 


(32) 


v(s,l) 


v(s,0) 
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Eliminating 

v(t,0)  -  |,  (v(t,l)-  pv(t-l,l)  -  |6t  Q)   ,  | t | <s       (33) 

and  again  using  pp '  +  pq '  +  p'q  +  qq '  =  1   ,   while 
setting  v(t,l)  =  v(t)  we  have 

-s  <  t  <  s-1  :  p(v(t)  -  v(t-l))  +  p'(v(t)  -  v(t+l))  = 

|d+q')6t/0   -  ip-6^^  (34) 

v(-s)  =  0  =  v(s-l) 
On  solving  (34)  and  substituting,  there  results 


1  -  UAS  <"> 

X   =  P'/p      U  =  i'/q 

With  VT  sampling,  the  sample  size  directly  determined  the 
mean  excess  failures  during  sampling.   That  is,  each  pair 
of  tests  results  in  one  use  of  the  poorer  drug  and  hence 
p-p '  mean  excess  failures.   From  (29),  the  mean  "cost" 
during  sampling  is  then 

To  find  the  cost  in  the  PW  scheme,  we  can  insert  a  matrix 
1  0 


i  at  each  step  to  pick  up  a  muliplicative  factor  y  each 
time  drug  B  is  tried.   Hence  we  have  to  compute 
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cpw  =  <*-*'>  kln 


(1,0)  P   I  -  Q 


.»(;  ;|(:;|w 


(37) 


which  works  out  to 


(q  +  1^-)  (1  -  Xs)  (1  -  pX  -  qXS) 


'PW 


1  -  pX  -  qX 


2s 


(38) 


A  =  p'/p 


6 .   Comparison 

The  leading  question  is  whether  an  attempt  to  improve 
the  chances  of  an  individual  patient,  as  in  play-the-winner , 
results  in  a  substantial  disadvantage  to  the  whole  population 
The  answer  to  this  question  depends  upon  the  point  of  view 
adopted.   Suppose  first  that  we  want  to  distinguish  between 
the  two  drugs  with  high  probability,  p  (correct  choice)  >_  P*  , 
whenever  the  difference  in  effectiveness  exceeds  some 
thereshhold  p  -  p'  >  A*  .   If  the  mean  effectiveness 


(P  +  p') 


39; 


is  fixed,  this  sets  the  stopping  rule  termination 
parameter  s.   From  (26)  , 
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VT 


In 


1-P* 


/   In 


1a* 


+  iA* 


yA*) (q  -  h 


(40) 


and  from   (35) 


2q  -  (q  +  ±-A*)P^ 


s^„,  =  In = 

PW        iq    -    ^A*)(l-P< 


(41) 


p  -  i-A* 


Now,  using  (36)  and  (38) ,  the  ratio   Cpw  /  C 


be  plotted  as  a  function  of  p 


VT  can 

Doing  so,  one  finds  [2]  a 
relative  advantage 
depending  very  much  on 
where  in  (A*,  p  )  space 
the  comparison  is  made. 
In  particular,  for 
P*%  1  and  A*<<1   ,   PW 
is  superior  (has  lower 
mean  excess  failures) 
only  for  P  >  4  ~  §A*  ' 
while  VT  is  superior  in 
the  large  low  success  rate 


1.0 


region, 


Figure  1. 


Of  course,  as  we  have  previously  mentioned,  the  signif- 
icance of  mean  excess  failures  during   sampling  (at  fixed 
probability  of  choosing  the  better  drug)  is  somewhat  question- 
able, the  mean  total  excess  failure  depending  as  it  does  on 
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the  total  population  treated.  Thus,  for  estimated  horizon 
N  one  is  really  interested  in  choosing  the  sample  trunca- 
tion parameter  s   to  minimize 

C  =  C(sample)  +  (N-n (sample) (1  -  P(choose  A))(p-p')       (42) 

where  n  is  the  mean  sample  size  and  A  is  assumed  the 

better  drug.   If  the  pair  (p,p')  is  actually  known,  but  not 

its  allocation  to  the  two  drags,  this  results  in  a  very 

different  picture  [3] 

Table  1 

Total  Mean  Excess  Failure  at  p  -  p '  =  0 . 2 


irizon 

p 

=  0.2 

p  =  0. 

5 

P 

=  0.8 

|   FS 

VT 

PW 

FS 

VT 

PW 

FS 

VT 

PW 

io2 

14 

2.8 

2.6 

I   23 

3.8 

3.4 

:   14 

2.8 

2.0 

104 

28 

6.6 

5.8 

46 

10.4 

8.0 

1   28 

6.6 

4.0 

io6  1 

41 

10.0 

8.8 

j   68 

16.0 

13.2 

41 

10.0 

6.0 

In  the  range  covered,  PW  is  uniformly  superior  to  VT,  although 
not  by  much.   Both,  however,  are  much  better  than  the  fixed 
sample  FS  technique  (14). 

However,  if  only  an  upper  bound  on  N  is  known,  and 
a  range  of  possible  values  of  p  and  p',  the  choice  of 
optimal  s  -  to  minimize  the  maximum  C  consistent  with  these 
possibilities-leads  to  a  still  different  pattern  as  shown 
[3] 


Table  2 


Total  Mean  Excess  Failure  at  p 


=  0.2 


s   chosen  to  accord  with  N  <  10   0.3  <  p  <  0.9 
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actual  N 

p  = 

0.2 

P  = 

0.5 

P  = 

0.8 

VT 

PW 

VT 

PW 

1   VT 

! 

PW 

io2 

15 

36 

15 

21 

» 

5.6 

104 

15 

36 

15 

21 

1   15 

5.6 

io6 

15 

36 

16 

21 

1   » 

6 

Under  these  circumstances,  the  "ethical"  PW  strategy 
is  superior  only  for  sufficiently  high  p  . 

7.   Improved  Versions 


Many  modifications  of  the  basic  PW  and  VT  schemes 
have  been  proposed,  primarily  with  the  objective  of 
reducing  E (N  )  ,  the  expected  number  of  trials  with  the 
inferior  drug  during  the  testing  period.   Perhaps  the 
simplest,  due  to  Hoel,  Sobel  &  Weiss,   [4]  involves  a 
"pretesting"  period  in  which  each  drug  is  tested  nQ 
times,  resulting  in  success  numbers  AQ ,  BQ  .   If 
max (A  ,B  )  >  k   ,  some  critical  value,  PW  is  there- 
after employed,  otherwise  VT.   A  quite  small  value  of 
n   ,  say  5,  is  empirecally  effective  in  reducing  E(Nfi) 
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at  given  (A* ,p*) . 

Other  modifications  maintain  PW  strategy,  but  alter 
the  stopping  rule  so  that  sampling  also  ends  when 
each  drug  has  exceeded  a  prescribed  number  of  failures  - 
Berry  &  Sobel  [5]  -  or  when  the  total  failures  exceed 
some  cutoff  -  Fuschini  [6]. 

A  still  more  sophisticated   stopping  rule  -  Simon,  Weiss 
&  Hoel  [7]  -  employs  the  likelihood  function 

L(p,p')  -  pSp,S'qfq,f'  (43) 

for  s,  s1  successes,  f,f  failures  at  underlying 
probabilities  p,p',  and  stops  when  the  ratio 


A  =ix   /£■ 


(44) 


reaches  a  predetermined  upperbound   (or  its  reciprocal) , 
where 

£  X(A*)  =  max   L(p,  p-A*) 

A*  <  p  <  1 

dC  2(A*)  =  max   L(P  "  A*  '  P) 
A*  <  p  <  1 
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In  addition  to  using  this  in  the  context  of  PW,  these 
authors  have  also  suggested  an  "adaptive  assignment" 
(with  a  stopping  rule) :   try  drug  A  with  probability 
0  =  -= — — t-   ,   drug  B  with  probability  1  -  0  =  ■= — — j- 

Not  only  is  a  much  improved  strategy  for  low  enough 
p  achieved,  but  each  patient  during  sampling  also 
has  the  benefit  of  the  prior  history  of  patients. 

One  aspect  of  stopping  rule  strategies  is  worth 
noting.    Since  the  probability  of  a  correct  choice  on 
stopping  after  n  trials  is  usually  of  the  form   1  -  a   , 
and  the  number  of  poor  drug  choices  during  the  trials 
proportional  to  n,  it  follows  that  if  n   is  adjusted 
optimally  for  patient  horizon  N,  both  mean  n  and  mean 
cost  will  go  as  InN.   This  is  a  standard  against  which 
purported  ethical  strategies  must  be  measured,  a  matter 
to  which  we  now  turn  our  attention. 


8.   Testing  Without  Termination 

We  have  thus  far  laid  great  emphasis  on  the  importance 
of  terminating  the  sampling  with  despatch  and  deciding 
upon  the  better  drug.   With  modern  methods  of  information 
storage  and  retrieval,  this  philosophy  is  less  compelling, 
and  there  is  little  reason  not  to  go  on  "forever",  while 


22 


making  the  treatment  strategy  as  ethical  as  possible 
What  strategies  then  are  suggested?   The  PW  scheme 
gives  us  an  idea  of  what  to  expect  as  a  result  of 


a  probable  excess  loss  of  1-  p  =  q  ;   if  A  is  tried, 
B  is  never  tried  again,  leading  to  no  increase  of 
excess  loss.   Thus  the  only  possibilites  are  that  B 
is  tried  at  the  first  step,  with  a  probability  of  ~-  , 
it  succeeds   s   times  for  a  probability  of  p   ,  and  then 

fails  with  probability  q.   Hence  the  asymptotic 

1  2 

mean  excess  loss  is   -=-(q  +  pq  +  p  q  +  .  .  .  )  q   ,  or 


A 


1   :     C    *  \   q  (46) 


far  better  thean  the  generic  N     stage  mean  excess 


On  the  other  hand,  suppose  that  p   <  p   <  1  . 

Now  A  has  a  non-zero  probability  of  failing,  so  that 
B  will  keep  on  being  tried.   Only  the  limiting  mean 
excess  loss  per  trial  over  N  trials  will  converge  as 
N  -*■  ~ 


lim    -^  =  (p-p)P (choose  B)         (47) 
N-»-» 
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A  run  of  exactly   n  trials  of  B  occurs  with  probability 

n-1 
pBqB   yielding  a  mean  length  of 

lqB    +    2PB*B    +    ^1%    +     ••'    =    %  • 


Hence,    P(try   B)    =  ^     /l        1  =      q     / 

V^A      %  A/qA+qB       '    and 


conclude  that 


c 


V^A 


(48) 


far  worse  asymptotically  than  the  generic  c   =  lnN/N  . 

In  fact  (48)  has  a  maximum  for   q   >  q    of 

c^  =  3  -  2/2  =  0.172   at  qfi  =  1   ,  q   =  /7  -1  =  0.414...  . 


This  attempt  to  introduce  ethical  considerations 
by  at  least  retaining  the  result  of  the  preceding 
treatment,  if  not  terminated,  hence  exacts  a  large  penalty 
(48)  from  the  full  population  of  patients.   We  now 
turn  to  the  major  thrust  of  this  lecture:   how  does  the 
situation  change  when  each  patient  is  given  the  advantage 
of  the  information  accumulated  by  the  result  of  testing 
all  previous  patients?   Everything  hinges  of  course  on 
just  how  this  information  is  used  to  advantage,  and  for 
this  purpose  we  adopt  a  Bayesian  point  of  view  [8] .   We 
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suppose  a  symmetric  a-priori  distribution  of  the  two 


N=A+B+a+b   trials  with  A,B  successes,  a,b 
failures,  the  a-posteriori   f  (p  ,p  | A,B ,a ,b)   is 


determined  by 


fN(pA/PB|A,B,a,b)f (A'B'a,b)  =  f (PA'PBJA'B,a,b) 
=  f (A,B,a,b|pA, 

~    [   A  j  {   a  j  PA 


f(A,B,a,b|pA,PB)f0(pA,pB)  = 


B   a  b   _  .      , 
PB  qA  ^B   V^'V 


Hence 


fN(pA,PB|A,B,a,b)  =^ABab  PA  PBB    q*  qbB    f0(PA,PB)         (50] 


for  a  suitable  normalization  constant  "t* 


Bab 


If  the  a-priori   f.(p  ,p  )   is  taken  as  a  Beta- 
distribution. 


fo  (Pa'V  ="o  PaVb  4  (51) 


then  this  form  is  retained  in  f  which  is  a  computational 
advantage.   Now  we  can  write 

*   f„  „  i,  „    Ws    ,,    A+e  a+f   B+e   b+f          ,c„. 

fN' (pA'pB|A'B'a'b)  =  ^  npa  qA      pb      qB                      (52) 
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This  is  as  if  there  had  been   2e  +  2f  trials  before 
the  first  patient,  with  e  successes  and  f  failures 
for  both  drugs  A  and  B.   The  advantage  to  be  taken 
of  (52)  is  clear  enough.   It  follows  at  once  from 
(52)  that  after  N  trials 


E(PA}     A+e+l 


a+f+1 


1.   Cjp  ,pB,  e,f)  =   lim  CN  < 
N-h» 


2.   C  (P,,PR,  e,f)  -   lim  C  /N>  0 


(53) 


and  similarly  for  drug  B.   We  therefore  adopt  the 
strategy  for  each  patient  entering  the  sequence 


choose  A     \  J  >0 

flip  for  A  or  B  |j>  if  (A+e+l)  (b+f +1)  -  (B+e+1)  (a+f+1)  k  =0   (54 
choose  B  I  <t) 


With  the  strategy  (54)  we  must  now  complute 
the  mean  excess  failures.   If  p„  >  p_   then  after  N 


E(aN  +  bN  =  ^  (55) 


Referring  back  to  (46)  and  (48) ,  there  are  two 
regions  to  focus  on: 


(56) 


2  6 


In  case  2 ,  we 

also  have 

Coo  ■   (PA  ' 

"  PB)P 

where  3  =  lim 

E(NB  =  BN  +  V 
N 

(57) 


is  the  probability  that  the  sampling  process  will  be 
"trapped"  in  the  poorer  drug  B. 

9.   No  Bias:   Prototype 

We  now  have  to  analyze  the  development  of  the 
process  represented  by  (54).   All  of  the  information 
is  contained  in  P  (A,B,a,b),  the  probability  that 
after  N  steps,  we  will  have  had  A,B  successes 
a,b  failures  of  the  two  drugs.   Of  course, 

P0(A,B,a,b)  =  6AiQ    6B/0    6a/Q  6hf0  (58) 

and  since 

A+B  +  a  +  b  =  N  (59) 

the  subscript  N  can  be  dropped.   It  will  also  be 
convenient  to  introduce 

P1      =  9  [  (A+e+1)  (b+f+1)  -  (B+e+1)  (a+f+1)]  P. 


ABab  J   ABab 

; 

ABab 


P2     -  6  [  (A+e+1)  (b+f+1)  -  (B+e+1)  (a+f+1 )]  PABab 


(60) 
where  0(x)  =  1-6 (x) 
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(61) 


9  (x)  defined  by  (8).   According  to  (54)  ,  P    ,   is  the 

probability  that  A  will  be  tried  at  the  next  step, 
.2 


It  then  follows,  just  as  in  (31)  but  including  the 
initial  state,  that 


1  2 

PABab    PA  P  A-l,Bab    +   PB  P  A,B-l,ab 


1  2 

+  qA  P  AB,a-l,b  +  qB  P  ABa,b-l  +  6ABab,0000 


This  is  a  four  variable  partial  difference  equation  with 

nonconstant  coefficients,  a  quite  difficult  object  to 

deal  with.   However,  assuming  that  it  has  been  solved, 

the  mean  excess  total  failures  is   readily  computed. 

Since  trying  B  entails  a  mean  excess  failure  of  p   -  pR 

2 
and  the  probability  of  trying  B  is  P    of  the  previous 

step,  we  have  at  once 


(PA  "  PB}      ^       p2ABab  (62) 

A     B   A+B+a+b  <  N    ABaiD 


Let  us  start  our  examination  of  unterminated  ethical 
strategies  with  the  case  of  no  initial  bias  towards 
success  or  failure: 
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no  bias:    e  =  f  =  0  (63) 

Since  this  is  still  a  difficult  analytical  problem, 
we  first  consider  the  extreme 

PA  =  1  (qA  =  0)  with  pB  =  p   ,  qB  =  q  (64) 

as  we  did  in  (46) .   Since   a   remains   0,  it  can  be 
dropped  as  an  index,  and  (61)  becomes 


PABb  =  plA-l,Bb  +  Pp2A,B-l,b  +  ^Vb-l  +  6ABb,000     (65) 


1       2 
with  P   and  P   given  by  (60)  at  e  =  f  =  a  =  0  .   To 

include  (60) automatically  we  introduce  a  generating 

function 

■W"«    ■  |PABbzAt^"b+1»-<B+1> 


which  converges  in  the  complex  plane  for  |t|  =  1  at 
|z|  <  1  ;   and  further  decompose   this  via 


ABb  =  P  ABb  +  P  ABb  int°  PBbiZ't)     =    plBb(z't)  +  ^Bb^'t^    (67) 


According  to  (60)  we  thus  have 

P  (z,t)  is  a  MacLaurin  series  in  t 

2    1  .    . 

P  (z,-)  is  a  Laurent  series  in  t 

t  (68) 

PX(z,0)  =  P2  (z,0) 
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On  summing  over  A  with  the  weight  of  (66) ,  (65) 
reads 

PBb(2,t,  -  ,tb+1  P^C.t)  +  1  P2B.i,b'2'  I" 

2      ,     1  (69) 

+  <*  P  B,b-l(Zt'  t  )  +  6Bb,00 

If  we  are  interested  in  Cro   ,  it  is  convenient  to  sum 

(69)  over  all  B.   Setting  Pb(z,t)  =  I  PBb(z,t)   this  Yields 

B 

(1  -  ztb+1)  Pb(z,t)  =  qtp2_l(zt,t)  -  (1-2)  Pj  i*,\) 

(70) 
+  6b,0 

2    1 
It  is  not  hard  to  show  from  (70)  that  Pb(z,-)  is 

independent  of  z .   In  fact,  a  detailed  proof  is  unnecessary: 

since  a=0,   drug  B  will  only  be  tried  if   A  _<  B  at  every 

step  of  a  chain  of  trials  from  B=0  on;   hence,  A=0 .   Taking 

z=0  and  dropping  the  associated  argument,  we  have 


Pb(t)  =  qtPb_x   (t)    "  (  1  -  ?)  Pb  {l]     +    6b,0 


pb(0)  =  Pb(0)  (71) 


eq 


(71)  is  easy  to  solve.   We  take  the  Laurent  part 
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Pb(0>  "  *{*£-!  (£>  "  Pb-l(°j)   "  (1  "  t)Pb(£}  +  6b,0      (72) 

1         2 
use  P   (0)  =  P,  (0)   and  sum  over  all  b,  dropping  the 

associated  index: 


P2(0)  =  qt  fp2  (i)  -  P2(0)j   -  (1  -  2)  P2(i] 


+  1 


.2,1,     y       _A  ^(A+l)  (b+1)  -(B+l)„2 
ABb 


where    p2(±)  =    I      z   t  *"  *' PABb 


Thus 

.2 


P  (t 

C      (1  -  t) (q-  p/t) 


From  (62) 


(73 


2  1   =  l-p-(O) (1  +  qt)  (74) 


C   =  qP2(l)  (75) 


which  will  be  finite  only  if  the  numerator  of 
(74)  vanishes  at  t  =  1 : 


P2<0>  -^ 


The  remaining  pole  of  (74)  occurs  outside  of  the 
region   |£|  _f  1    only  if  q  >  p  ,  and  so  we  conclude 
on  substituting  (74),  (76)  into  (75)  that 
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:i+gB)  (i 


2PT 


(77) 


looking  as  shown.   If  p_  >  i  , 
B    2 


an  extension  of  the  previous 
analysis  shows  that  then: 


Figure  2 


-11.  j= 

N->oo 


1   " 


1  "  K 


(78) 


c 
.072 


.5  1 

PR 


Figure  3 
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10.   No  Bias  :   General 


We  proceed  to  the  general  case  of  unbiased 
a-priori  distribution:    f . (p   ,  p  )  =  1.   Our 
evaluation  will  still  be  made  in  terms  of  the  asymptotic 
mean  excess  failures,  with  finite  C    signifying  an 
asymptotically  "safe"  point  in  (p   ,  p  )  space.   From 
the  viewpoint  of  the  trapping  probability   3  of  (57) , 
there  is  a  region  of  the  (papR)  space,  including  (1,0), 
in  which  3=0  throughout.   Crossing  the  boundary  of 
this  region  one  has  a  "phase  transition"  and  3  becomes 
non-vanishing,  so  that  the  sampling  process  can  branch  asymp- 
totically  to    repeated  sampling  of  either  the  better 
or  worse  of  the  two  drugs.   In  this  latter  region, 
the  mean  excess  failures  depends  upon  the  patient  horizon 
N  and  the  sampling  parameters  for  optimal  strategy  should 
therefore  depend  on  N  as  well.   However,  we  will  concen- 
trate our  attention  in  this  lecture  on  the  3=0  regime, 
and  hence  on  the  total  mean  failures  C 

Since  our  procedure,  like  any  other,  is  most  effective 
in  the  extreme  case  p  =  1,  p   =  0,  a  sensible  analysis 
should  focus  on  the  penalty  exacted  by  non-vanishing  values 

qA        a  and  PR  •   For  this  purpose,  we  may  rewrite 
(61)  as 


3  3 


P      -  P1         -  P2 
ABab      A-l,Bab      ABa,b-l  = 


6ABab,0000  +   qA(P  AB,a-l,b    P  A-l,Bab) 


2  2 

+   PB  (P  A,B-l,ab  "  P  ABa,b-l 


and  carry  out  an  expansion  with  respect  to  q   and  p  . 
This  is  not  trivial,  due  to  non-constant  coefficients 


,X   and  P2 
expansion  is  already  known,  since  (77)  expands  out  to 


implicit  in  P   and  P  .   Of  course,  part  of  the  q   ,  p_, 

A  B 


,       ^b+2 
t   -    XqA  =    ApAt 


t  (A)    ->   0      as    A    ->    0 


(79) 


CJ°'PB>    =    <1"PB)  [\  +   ?PB    +   ^PB   +   r|PB   +    '••]  (80) 


Similarly,  one  can  with  considerably  greater  difficulty, 

solve  the  p_  =  0   case,  obtaining 

*b+l        * 
Cco(qA,0)  =  d-qA)(l+qA)    I   tfa      (qA+  %)  (81) 

b=0 


where  t  ,   =  t,  (1)   and  t,  (A)   satisfies 
b     b  b 


(82) 


On  expanding,  we  find 


The  cross  terms,  however,  must  be  picked  up  by 
laborious  appliecation  of  (79) .   Through  second 
order,  this  results  in 


C    (qa,pj    =    (Pn-Pn)     fy  +   |pB   +   |qa    +   4    <P«   +   **>    + 
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(1  -<W  [?  +  k  +  nhi  +  •••]  (83) 


4^B         4^A 
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How  is  an  expansion  such  as  (84)  to  be  used?   In 

particular,  can  we  use  it  to  estimate  the  boundary  in 

(q   ,  p_)   space  at  which  the  transition  from  untrapped 
A     B 

to  trapped  sampling  takes  place?   To  do  so,  we  convert 
(84)  to  a  Pade  type  rational  fraction  expansion.   First 
introduce  an  expansion  parameter  y  :   pB  -»-  PB»C3A  "*  "Y<3A 
and  then  convert  the  y  series  to  a  continued  fraction: 


(84) 


2 
1  +  ay  +  by   +  . . .  =  1 


ay 


i-h 


=  (a  +  (a2-  b)Y  +  ■■■)  /  (a  -  bY  +  ...)  ■   In 
the  present  case,  this  yields 
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3  5  12         7    2 

2PB    +    2%    "    2PB   +    2^A 


^A   + 


Cco(<3A'PB)    =    2(PA~PB)     3 —5 H    2 

2PB   +    2%    "    4~PB    "    4~^A    "    2~PBqA 


(85! 


so  that  the  transition  boundary  is  given  by 


2PB  +  2^A  "  4-p 


11  2    11  2    21 


B    4  MA    2  ^BMA 


P«<3a  +  •• 


(86! 


as  shown . 
Despite  the 
rough  nature 
of  the  computa- 
tion, this 
result  compares 
very  well  with  a 
numerical  simu- 
lation that  has 
been  performed, 
using  100  runs 
of  1000  patients 
at  each  point  of 
a  (PA>PB)  grid  with 
grid  spacing  0.1. 


Figure   4 . 
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At  this  point,  let  us  pause  to  inquire  as  to  how 
much  has  really  been  accomplished,  compared  for  example 
to  the  unterminated  PW  scheme.   Indeed,  at  pA  =  1,  PW 
yield   a  finite  C   ,  which  is  true  for  our  fully  ethical 
procedure  at   0   bias  only  for  p   <  y   (even  then,  PW 


different.   There,  as  we  have  seen  in  (48),  only 


°^+<1t 


(87) 


is  finite  and  C   tt  N   (not  due  to  trapping,  to  be 

sure,  but  rather  to  continued  sampling  of  both  drugs) . 

A  tabular  comparison  of  PW  and  "zero  bias  ethical"  shows 

that  not  only  does  the  latter  have  an  extensive  region 

in  which  C   remains  finite,  but  when  it  is  not   finite, 

a  smaller  B  value  results  through  most  of  the  (PA'PB>  plane. 
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Table  3 

100  B 

34 

N  =  1000 

42 

40 
39 

36 
29 

No  Bias 

41 

31 

20 

15 

32 

19 

9 

3 

3 

39  22 

8 

2 

2 

0 

32  15   7 

4 

1 

1 

0 

16  11   3   1 

1 

0 

0 

0 

9   4   10   0 

0 

0 

0 

0 

0  0   0   0   0   0 

0 

0 

0 

0 

47 


Table  4 

100  3 

33 

0 

0 

N  =  oo 

40 

25 

0 

P.W. 

43 

33 

20 

0 

44 

38 

29 

17 

0 

45 

40 

33 

25 

14 

0 

46  42 

36 

30 

22 

13 

0 

47  43  39 

33 

27 

20 

11 

0 

7 

44  40  36 

31 

25 

18 

10 

0 

4 

41  38  33 

29 

23 

17 

9 

0 

11.   Sampling  with  Bias 

The  problem  with  our  no  bias  ethically  motivated 
sampling  procedure  is  quite  evident  from  Figure  4.   There 
is  a  non-vanishing  probability  3  for  the  process  to  go 
asymptotically  to  repeated  testing  of  the  poorer  drug 
unless  the  difference  between  pa  and  pR  is  substantial. 

This  is  true  even  at  p.  =  1  (  when  p   >  y)   ,  the  one  place 
when  unterminated  PW  is  totally  effective.   What  happens 
is  that  an  early  fluctuation  leading  to  a  poor  showing  on 
trial  of  the  better  drug  a  establishes  a  reference  that 
can  be  consistently  exceeded  by  the  poorer  drug   B.   The 
remedy  is  clearly  to  assume  initially  a  high  level  of 
performance  by  both  drugs,  so  that  an  anomalously  low 
reference  will  not  be  established.   This  is  most  readily 
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accomplished  in  the  present  context  by  choosing  a  value 
e  >  0   in  the  a-priori  distribution   f-   of  (51) , 
resulting  to  be  sure  in  a  prolonged  period  during  which 
the  previous  test  results  enter  with  a  lower  weight  into 
each  decision. 

A  quick  estimate  of  the  effect  of   e  >  0   bias 
(with  f=0)   can  be  gotten  by  generalising  the  pA  =  1 
case  of  (77)   to  e  >  0 .   If  this  is  done,  one  finds 


1  +  PB    ")  T  -       Prt+1 


An 


where  t  >  1  satisfies 


Te+2  _  1   xe+l  +  ^B   = 
PB         PB 

Now  Cm     will  remain  finite  until  the  large  root  of  (89) 
falls  to  1,  yielding  a  double  root  of  (89)  at  x  =  1 ,  which 
is  readily  seen  to  occur  at 


K    =    1,  P„    ....   ,  =  ^P7  (90) 

A     '  ^B  critical    e+2 


In  other  words,  the  right  intercept  of  the  C^  transition 
curve  is  pushed  up  from  p  =  y  at  e=0  towards  its  max- 
imum possible  value  of  p.  =  1.   But  does  the  rest  of  the 
curve  follow  along?   Suppose  we  choose  e  =  10   ,  so  that 
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on  a  (p, ,pR)   grid  of  spacing  0.1,  the  whole  right  edge 
(below  p  =p  which  we  never  include)   will  have  finite 

C   ,  and  again  carry  out  numerical  simulation  with  100 
sequences  of  patients  at  each  grid  point.   For  these 
finite  samples,   6  is  assessed  (as  it  was  before)  by 
counting  the  ratio  of  sequences  in  which  the  last  patient 
receives  the  drug  B.   With  200-patient  sequences,  continued 
testing  by  the  poorer  drug  still  occurs  for  p   -  pR  =  0 . 2  , 
but  closer  to  the  asymptotic  limit  at  N  =  1000,   6  remains 
0  until  pA  -  pR  =  0.1 


Table  5 

100  3 

15 

5 
0 

N  =  200 

15 

1 

0 

ias  (10,0) 

21 

3 

0 

0 

21 

2 

0 

0 

0 

30   4 

0 

0 

0 

0 

34   5   0 

0 

0 

0 

0 

15   1   0   0 

0 

0 

0 

0 

33   2   0   0   0 

0 

0 

0 

0 

10   0   0   0 

0 

0 

0 

0 

Table 

6 

L 

100  6 

0 

N  =  1000 

3  0 
5  0  0 

Bias  (10,0) 

5 

0  0  0 

1 

0 

0  0  0 

0 

0 

0 

0  0  0 

1 

0 

0 

0 

0  0  0 

I                   1  o 

0 

0 

0 

0  0  0 

0  0  0 

0 

0 

0 

0  0  0 

0  0  0  0 

0 

0 

0 

0  0  0 

1 

p 

A 

1 

21 

Pa 


How  do  we  measure  the  effectiveness  of  the  strategy 

compiled  in  Tables  5  &  6?   It  is  certainly  not  wonderful 

for  p,  -  p^  <  0.1  .   But  of  course   clinical  treatments 
*A    *B  - 

are  not  highly  stylized,  nor  are  the  patients  equivalent, 
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so  that  the  success  probability  at  each  drug  must  be  con- 
sidered to  have  a  distribution  as  well.   For  this  reason, 
one  finds  in  the  literature  that  the  smallest  difference 
that   one  is  called  upon  to  discriminate  is  generally  taken 
as  0.2.   Hence  a  comparison  at   p  -p   =  0.2  is  called  for. 
This  has  been  given  for  the  optimal  "traditional"  strategies 
in  Tables  1  &  2.   In  Table  7  we  list  the  corresponding 
values  of  C^-.,   and  C, „„„    associated  with  the  simulations 
of  Tables  5  &  6. 


Table  7 
Mean  Excess  Failures  for  "Ethical"  Sampling 

Bias    (10,0) 

VpB 


N 

p   =   0.2 
6.7 

p   =    0.5 
4.5 

P   : 

=    0.8 

200 

1.6 

1000 

8.6 

6.3 

2.1 

Consider  first  Table  1.   Although  the  Biased  Bayes 
(Ethical)   criterion  used  in  Tables  5  &  6  is  unoptimized 
and  for  an  infinite  patient  horizon,  it  is  superior  to 
"traditional"  methods  except  for  small  population  and  low 
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success  probabilities  .   As  we  know,  and  observe  from 
Table  1,  C„  a  lnAT  for  stopping  rule  methods  so  that 
the  unterminated  ethical  procedure  becomes  better  as  N 
increases.   On  the  other  hand,  if  the  expected  values  of 
p  , pR  and  horizon  are  poorly  known,  as  in  Table  2,  the 
Biased  Bayes  is  uniformly  superior. 


12.   Conclusion 


We  conclude  that  a  simple  Bayes  Criterion  which 
satisfies  reasonable  standards  of  ethical  practice,  employed 
without  a  termination  procedure,  produces  a  success  rate 
for  large  population  which  is  at  least  comparable  to  that 
achieved  by  sampling  methods  not  possessing  the  same  ethical 
character.   The  question  of  optimal  strategy  for  a  given 
patient  horizon,  as  well  as  modified  treatment  criteria  for 
this  purpose,  is  now  under  intensive  investigation. 


*   Supported  in  part  by  the  Department  of  Energy  under 
Contract   DE-AC02-76ER03077 
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